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DETAILED ACTION 


Response to Amendment 

1 . Applicant's arguments with respect to claims 1-33 have been considered but are 
moot in view of the new ground(s) of rejection, due to the claim amendments. The 
amendments filed overcome the previous rejection by more clearly defining the 
applicant's invention as a speech recognition system that has a plurality of noise models 
pertaining to noise type and each noise type having a model for a plurality of noise 
levels. 


Claim Rejections - 35 USC § 103 

2. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set 
forth in section 102 of this title, if the differences between the subject matter sought to be patented and 
the prior art are such that the subject matter as a whole would have been obvious at the time the 
invention was made to a person having ordinary skill in the art to which said subject matter pertains. 
Patentability shall not be negatived by the manner in which the invention was made. 

3. Claims 1,2, 4-5, 9, 10, 12, 13, 15-16, 20, 21, 23, 24, 26, 27, 31, 32, 34, 36, 37, 
39, 40 and 42 are rejected under 35 U.S.C. 103(a) as being unpatentable over 
Wakisaka (U.S. Pat 6,148,105) in view of Wymore (U.S. Pat 6,631,348). 

Wakisaka teaches a speech recognition system comprising: 
creating speech data on which different types of noise have been superposed 
(voice contains noise, col. 13, lines 1-3); 
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creating and storing acoustic models according to each of the noise types 
(creates multiple acoustic models under different noise environments, col. 14, lines 35- 
39); 

during speech recognition: determining the type of noise superposed on speech 
data to be recognized (recognizes the type of noise, col. 13, lines 41-45); 

selecting the corresponding acoustic model corresponding to the determined 
noise type (determined noise environment is used to search for an acoustic mode for 
voice recognition hence selecting a model, col. 13, lines 41-48); 

eliminating the noise using a predetermined noise elimination method in the 
training and speech recognition processes (noise deletion unit, col. 13, lines 29-34); and 

perform speech recognition based on the selected model (acoustic collating unit 
collates the input voiced with an acoustic model and produces a recognition result, col. 
13, line 63 to col. 14, line 3). 

Wakisaka does not teach the acoustic models corresponding to each of the noise 
types also contain a plurality of S/N ratios for each noise type. 

Wymore teaches acoustic models corresponding to types of noise and a plurality 
of S/N ratios for each noise type (col. 4, lines 18-27). Specifically Wymore teaches 
different noise levels which implies the noise levels having different SNRs. 

It would have been obvious to one of ordinary skill in the art at the time of 
invention to modify the system of Wakisaka to have the acoustic models correspond to 
both noise type and noise level as taught by Wymore because, as taught by Wymore, 
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moving from a serene environment to an environment with a high level of noise without 
changing S/N models would decrease accuracy (col. 2, lines 4-20). 
4. As per claim 2, Wakisaka teaches the speech recognition method according to 
claim 1 , wherein the noise elimination method is at least one of a spectral subtraction 
method and a continuous spectral subtraction method, and the acoustic models are 
created by eliminating the noise by the at least one of the spectral subtraction method 
and the continuous spectral subtraction method from each of the speech data on which 
the different types of noise have been superposed, obtaining the feature vectors of each 
of the speech data which have undergone the noise elimination, and using the feature 
vectors; 

when a speech recognition is performed, a first speech feature analysis is 
performed to obtain frequency-domain feature data of the speech data on which the 
noise has been superposed (obtains the spectrum for spectral subtraction from the 
inputted announcement voice, col. 15, lines 43-46); 

a determination is made whether the speech data is a noise segment or a 
speech segment based on the result of the feature analysis, and when a noise segment 
is detected, the feature data thereof is stored (stores in the database data of the overall 
sound when there is no voice hence a determination is made if a speech segment is 
present, col. 14, lines 7-12), whereas when a speech segment is detected, the type of 
the noise superposed is determined based on the feature data having been stored and 
a corresponding acoustic model is selected from the acoustic models corresponding to 
each of the noise types based on the result of the determination (determined noise 
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environment is used to search for an acoustic mode for voice recognition hence 
selecting a model, col. 13, lines 41-48); 

the noise is eliminated by the at least one of the spectral subtraction method and 
the continuous spectral subtraction method from the speech data to be recognized on 
which the noise has been superposed (performs spectral subtraction, col. 15, lines 43- 
46); and 

a second feature analysis is performed on the speech data which has undergone 
the noise elimination to obtain feature data required in the speech recognition (sound 
analysis unit performs feature extraction processing on the noiseless voice, col. 13, 
lines 57-61) and a speech recognition is performed on the result of the feature analysis 
based on the selected acoustic mode! (acoustic collatinn unit collates the innut voiced 
with an acoustic model and produces a recognition result, col. 13, line 63 to col. 14, line 
3). 

5. As per claims 4, 1 5, and 26, Wakisaka teaches eliminating the noises from each 
of the speech data by a predetermined noise elimination method, and using the feature 
vectors of each of the speech data which have undergone the noise elimination (stores 
data of voice that was obtained by removing noise, col. 14, lines 7-12). 

Wakisaka does not teach the acoustic models corresponding to the plurality of 
S/N ratios for each of the noise types are created by generating speech data on which 
noises with the plurality of S/N ratios for each of the noise types have been respectively 
superposed. 
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Wymore teaches the acoustic models corresponding to the plurality of S/N ratios 
are created by generating speech data on which noises with the plurality of S/N ratios 
for each of the noise types have been respectively superposed and generates reference 
patterns for the multiple noise levels based on the training information (col. 4, lines 1- 
36). 

It would have been obvious to one of ordinary skill in the art at the time of 
invention to modify the system of Wakisaka to create acoustic models for a plurality of 
S/N ratios from training data as taught by Wymore because using a semi-clean speech 
model to recognize speech would give better recognition results than using only a noisy 
speech model. 

6. As per claims 5, 16, and 27, Wakisaka does not teach when the acoustic models 
corresponding to the plurality of S/N ratios for each of the noise types are created, in 
addition to determining the type of the noise superposed on the speech data to be 
recognized, the S/N ratio is obtained from a magnitude of the noise in a noise segment 
and a magnitude of the speech in a speech segment, and an acoustic model is selected 
based on the S/N ratio obtained. 

Wymore does not explicitly teach estimating the S/N ratio from the magnitude of 
the noise in the noise and the magnitude of speech in the speech segment, but he 
teaches choosing the acoustic model based on S/N ratios (noise levels, col. 4, lines 48- 
52). 

It would have been obvious to one of ordinary skill in the art at the time of 
invention to modify the system of Wakisaka to obtain the S/N ratio and select an 
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acoustic model based on both the noise type and S/N ratio as taught by Wymore 
because it would give a more robust estimate of the S/N ratio and hence giving a better 
estimate to choose a most appropriate acoustic model. 

7. As per claims 9, 20 and 31 , Wakisaka teaches a speech recognition system 
comprising: 

creating speech data on which different types of noise have been superposed 
(voice contains noise, col. 13, lines 1-3); 

eliminating the noise using a predetermined noise elimination method in the 
training and speech recognition processes (noise deletion unit, col. 13, lines 29-34); 

creating and storing acoustic models according to each of the noise types 
(creates multiple acoustic models under different noise environments, col. 14. lines 35- 
39); 

during speech recognition: determining the type of noise superposed on speech 
data to be recognized (recognizes the type of noise, col. 13, lines 41-45); 

selecting the corresponding acoustic model corresponding to the determined 
noise type (determined noise environment is used to search for an acoustic mode for 
voice recognition hence selecting a model, col. 13, lines 41-48); 

perform speech recognition based on the selected model (acoustic collating unit 
collates the input voiced with an acoustic model and produces a recognition result, col. 
13, line 63 to col. 14, line 3), 
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wherein, when speech data on which another type of noise has been superposed 
is created, other acoustic models are created corresponding to the other noise type 
(creates acoustic models from noise and noiseless voice data, col. 14, lines 7-23). 

Wakisaka does not teach the acoustic models corresponding to each of the noise 
types also contain a plurality of S/N ratios for each noise type and creating them as 
such. 

Wymore teaches acoustic models corresponding to types of noise and a plurality 
of S/N ratios for each noise type (col. 4, lines 18-27). Specifically Wymore teaches 
different noise levels which inherently suggests the noise levels having different SNRs. 

It would have been obvious to one of ordinary skill in the art at the time of 
invention to modify the system of Wakisaka to have the acoustic models correspond to 
both noise type and noise level as taught by Wymore because, as taught by Wymore 
moving from a serene environment to an environment with a high level of noise without 
changing S/N models would decrease accuracy (col. 2, lines 4-20). 

8. Regarding claims 10, 21 , and 32, Wakisaka teaches a system for reducing noise 
in speech signal that uses spectral subtraction (col. 15, lines 43-50). 

9. As per claim 34, 36, 37, 39, 40 and 42, neither Wakisaka nor Wymore specifically 
teach the total number of acoustic models equals N x L, where N is a number of 
different noise types, and L is a number of S/N ratios for each of the noise types. 

However, the obvious combination of using N multiple noise type models taught 
by Wakisaka and the L multiple noise level models taught by Wymore would necessarily 
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produce the total number of acoustic models being the product of noise type models 
and noise level models. 

10. Claims 3, 6-8, 11, 14, 17-19, 22, 25, 28-30, 33, 35, 38 and 41 are rejected under 
35 U.S.C. 103(a) as being unpatentable over Wakisaka in view of Wymore as applied to 
claims 1,12, and 23 above, and taken in further view of Takagi (U.S. Pat 5,890,113). 

As per claims 3, 14, and 25, Wakisaka teaches storing feature data when noise 
is detected (no announcement voice, col. 14, lines 7-12) and storing feature data when 
speech is detected (stores data from voice obtained by removing noise, col. 14, lines 7- 
12). 

Wakisaka and Wymore do not teach a feature analysis to obtain a vector of 
cepstrum coefficients for use in detecting noise. 

Takagi teaches extracting cepstrum coefficients from the sequence for speech 
recognition (analyzing unit, col. 7, lines 15-20) and uses it to detect noise (speech parts, 
col. 7, lines 44-46). 

It would have been obvious to one of ordinary skill in the art at the time of 
invention to modify the system of Wakisaka and Wymore to extract cepstral features 
from the signal to be recognized as taught by Takagi because cepstral coefficients have 
highly desirable properties for speech recognition and classification. 

Wakisaka and Wymore do not teach using cepstrum mean normalization method 
in noise elimination. 
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Takagi teaches using the cepstrum mean normalization to extract noise from an 
inputted speech signal in a speech recognition system (environmental adapting unit, col. 
7, lines 37-40). 

It would have been obvious to one of ordinary skill in the art at the time of 
invention to modify the system of Wymore and Wakisaka to eliminate the noise through 
cepstrum mean normalization because it is known to be a useful approach used for 
compensating for multiple distortions in a speech signal. 

11. As per claims, 6, 17, and 28, Wakisaka teaches a speech recognition system 
comprising: 

creating speech data on which different types of noise have been superposed 
(voice contains noise, co!. 13, lines 1-3); 

the noise is eliminated by the at least one of the spectral subtraction method and 
the continuous spectral subtraction method from the speech data to be recognized on 
which the noise has been superposed (performs spectral subtraction, col. 15, lines 43- 
46); 

creating and storing acoustic models according to each of the noise types 
(creates multiple acoustic models under different noise environments, col. 14, lines 35- 
39); 

when a speech recognition is performed, a first speech feature analysis is 
performed to obtain frequency-domain feature data of the speech data on which the 
noise has been superposed (obtains the spectrum for spectral subtraction from the 
inputted announcement voice, col. 15, lines 43-46); 
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a determination is made whether the speech data is a noise segment or a 
speech segment based on the result of the feature analysis, and when a noise segment 
is detected, the feature data thereof is stored (stores in the data base data of the overall 
sound when there is no voice hence a determination is made if a speech segment is 
present, col. 14, lines 7-12), and when a speech segment is detected, the noise is 
eliminated from the speech segment by the spectral subtraction method or the 
continuous spectral subtraction method (performs spectral subtraction, col. 15, lines 43- 
46); 

a second feature analysis is performed on the speech data which has undergone 
the noise elimination to obtain feature data required in the speech recognition (sound 
analysis unit performs feature extraction processing on the noiseless voice, col. 13, 
lines 57-61); 

when the speech segment has terminated, the type of the noise superposed is 
determined based on the feature data of the noise segment having been stored, and an 
acoustic model is selected from the acoustic models corresponding to each of the noise 
types (determined noise environment is used to search for an acoustic mode for voice 
recognition hence selecting a model, col. 13, lines 41-48); and 

a speech recognition is performed on the result of the feature analysis based on 
the selected acoustic model (acoustic collating unit collates the input voiced with an 
acoustic model and produces a recognition result, col. 13, line 63 to col. 14, line 3). 

Wakisaka does not teach the acoustic models corresponding to each of the noise 
types also contain a plurality of S/N ratios for each noise type. 
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Wymore teaches acoustic models corresponding to types of noise and a plurality 
of S/N ratios for each noise type (col. 4, lines 18-27). Specifically Wymore teaches 
different noise levels which inherently suggests the noise levels having different SNRs. 

It would have been obvious to one of ordinary skill in the art at the time of 
invention to modify the system of Wakisaka to have the acoustic models correspond to 
both noise type and noise level as taught by Wymore because, as taught by Wymore, 
moving from a serene environment to an environment with a high level of noise would 
decrease accuracy (col. 2, lines 4-20). 

Wakisaka and Wymore do not teach using a cepstrum mean normalization 
method to obtain feature vectors. 

Takagi teaches using the cepstrum mean normalization to extract noise from an 
inputted speech signal in a speech recognition system (environmental adapting unit, col. 
7, lines 37-40). 

It would have been obvious to one of ordinary skill in the art at the time of 
invention to modify the system of Wakisaka and Wymore to eliminate the noise through 
cepstrum mean normalization as taught by Takagi because it is a common approach 
used for compensating for multiple distortions in a speech signal. 

Wakisaka and Wymore do not explicitly teach using cepstrum coefficients in 
detecting noise. 

Takagi teaches extracting cepstrum coefficients from the sequence for speech 
recognition (analyzing unit, col. 7, lines 15-20) and uses it to detect noise (speech parts, 
col. 7, lines 44-46). 
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It would have been obvious to one of ordinary skill in the art at the time of 
invention to modify the system of Wakisaka and Wymore to extract cepstral features 
from the signal to be recognized as taught by Takagi because cepstral coefficients have 
highly desirable properties for speech recognition and classification. 
12. As per claims 7, 18, and 29, Wakisaka teaches eliminating the noises from each 
of the speech data by a predetermined noise elimination method, and using the feature 
vectors of each of the speech data which have undergone the noise elimination (stores 
data of voice that was obtained by removing noise, col. 14, lines 7-12). 

Wakisaka does not teach the acoustic models corresponding to the plurality of 
S/N ratios for each of the noise types are created by generating speech data on which 
noises with the plurality of S/N ratios for each of the noise types have been respectively 
superposed. 

Wymore teaches the acoustic models corresponding to the plurality of S/N ratios 
are created by generating speech data on which noises with the plurality of S/N ratios 
for each of the noise types have been respectively superposed and generates reference 
patterns for the multiple noise levels based on the training information (col. 4, lines 1- 
36). 

It would have been obvious to one of ordinary skill in the art at the time of 
invention to modify the system of Wakisaka to create acoustic models for a plurality of 
S/N ratios from training data as taught by Wymore because this would allow the models 
to be trained for different types and different levels of speech hence giving better 
speech recognition. 
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13. As per claims 8, 19, and 30, Wakisaka does not teach when the acoustic models 
corresponding to the plurality of S/N ratios for each of the noise types are created, in 
addition to determining the type of the noise superposed on the speech data to be 
recognized, the S/N ratio is obtained from a magnitude of the noise in a noise segment 
and a magnitude of the speech in a speech segment, and an acoustic model is selected 
based on the S/N ratio obtained. 

Wymore does not explicitly teach estimating the S/N ratio from the magnitude of 
the noise in the noise and the magnitude of speech in the speech segment, but he 
teaches choosing the acoustic model on S/N ratios (noise levels, col. 4, lines 48-52). 

It would have been obvious to one of ordinary skill in the art at the time of 
invention to modify the system of Wakisaka to obtain the S/N ratio and select an 
acoustic model based on both the noise type and S/N ratio as taught by Wymore 
because it would give a more robust estimate of the S/N ratio and hence giving a better 
estimate to choose a most appropriate acoustic model. 

14. As per claims 1 1 , 22 and 33, Wakisaka and Wymore do not teach using 
cepstrum mean normalization method in noise elimination. 

Takagi teaches using the cepstrum mean normalization to extract noise from an 
inputted speech signal in a speech recognition system (environmental adapting unit, col. 
7, lines 37-40). 

It would have been obvious to one of ordinary skill in the art at the time of 
invention to modify the system of Wakisaka and Wymore to eliminate the noise through 
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cepstrum mean normalization because it is a well-known and convenient approach for 
compensating for multiple distortions in a speech signal. 

15. As per claim 35, 38, and 41 , Wakisaka, Wymore and Takagi do not specifically 
teach the total number of acoustic models equals NxL, where N is a number of 
different noise types, and L is a number of S/N ratios for each of the noise types. 

However, the obvious combination of using N multiple noise type models taught 
by Wakisaka and the L multiple noise level models taught by Wymore would necessarily 
produce the total number of acoustic models being the product of noise type models 
and noise level models. 

Conclusion 

16. The prior art made of record and not relied upon is considered pertinent to 
applicant's disclosure. Goldberg et al. (U.S. Pat. 5,970,446) teaches creating noise 
models for multiple environments. 

Any inquiry concerning this communication or earlier communications from the 
examiner should be directed to Matthew J Sked whose telephone number is (703) 305- 
8663. The examiner can normally be reached on Mon-Fri (8:00 am - 4:30 pm). 

If attempts to reach the examiner by telephone are unsuccessful, the examiner's 
supervisor, Talivaldis Smits can be reached on (703) 306-301 1 . The fax phone number 
for the organization where this application or proceeding is assigned is 703-872-9306. 
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Information regarding the status of an application may be obtained from the 
Patent Application Information Retrieval (PAIR) system. Status information for 
published applications may be obtained from either Private PAIR or Public PAIR. 
Status information for unpublished applications is available through Private PAIR only. 
For more information about the PAIR system, see http://pair-direct.uspto.gov. Should 
you have questions on access to the Private PAIR system, contact the Electronic 
Business Center (EBC) at 866-217-9197 (toll-free). 
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